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Abstract 

This paper discussed the concept of computer competency and investigated the relationship between 
students’ computer competency and their perception of enjoyment and difficulty level of web-based dis¬ 
tance-learning courses. Participants were 237 entering graduate students in library and information sci¬ 
ence from a mid-southwestern state university in the United States from year 2001 to 2003. Computer 
competency was estimated by students’ self-report of their prior knowledge of information technology 
skills in a survey called Computer Skill and Use Assessment. Statistical significance was found between 
the correlation of computer competency and students’ perception of enjoyment level (p=.011) and diffi¬ 
culty level (p=.001). 


Introduction 

Distance education has become an integral 
component of services from libraries, including 
academic libraries that serve college of educa¬ 
tion. In recent years, library and information sci¬ 
ence fields have been exploring innovative ways 
of teaching and learning in digital era. For ex¬ 
ample, since the 1990s, distance learning in li¬ 
brary and information science education has 
developed quickly in the United States. Distance 
education via the World Wide Web, often com¬ 
bined with on-site meeting requirements, has 
been a trend in library and information science 
fields (Association for Library and Information 
Science Education, 1999, 7). The 2003 Associa¬ 
tion for Library and Information Science Educa¬ 
tion Statistical Report shows forty-six out of fifty- 
six ALA-accredited library schools reported 
1,155 courses offered as distance education, in 
comparison to 1,008 courses in 2001, 489 
courses in 2000, and 408 courses in 1999 (As¬ 
sociation for Library and Information Science 
Education, 2003). 

While LIS practitioners and researchers are of¬ 
fering instruction in different formats to provide 


students with more flexibility, they realize the 
potential challenge of learning from a distance. 
For example, the instructor needs sufficient in¬ 
structional and technical support in a same- 
time/different-place learning environment 
(Besser, 1996, 819). Many of the library educa¬ 
tors choose different-time/different-place models 
to deliver courses over the Internet to reduce 
cost and eliminate technical challenges by two- 
way video-conferencing (lighting, sound, and 
wiring of classrooms, et al). 

In asynchronous models, students can control 
the pace of instruction but students’ individual 
intellectual and technical background will impact 
learning effectiveness. An onsite environment 
makes it possible for instructors to adjust teach¬ 
ing strategies according to student feedback via 
eye-contact. Learners can think, watch, observe, 
and participate while communicating with the 
instructor and classmates. In web-based learn¬ 
ing environments, students without adequate 
technological background may spend more time 
struggling with technology than working on 
course content. Computer competency, or in¬ 
formation technology literacy, may influence 
students’ satisfaction with their performance 
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within an individual course and with their general 
experience of web-based learning in general. 
Thus, chances of dropping out may increase for 
those students dissatisfied with their distance 
learning experience (Sherry, Fulford, & Zhang, 
1998,4). 

Identifying factors impacting distance learning is 
more valuable to education libraries because 
their students will be next generation of educa¬ 
tors, who would explore pedagogical innovations 
at the rest of their life. The current study looked 
particularly at students at a library and informa¬ 
tion science program. Many of them were school 
librarians. This study explored how students’ 
computer competency can impact their percep¬ 
tion of enjoyment and difficulty level in web- 
based distance learning. 

Distance learning was defined in this study as 
the application of telecommunications and elec¬ 
tronic devices that enable learners to receive 
instructions originating from some distant loca¬ 
tion (Keegan, 1988; Holmberg, 1995, 51). In¬ 
struction may be synchronous or asynchronous. 
Distance education may employ correspon¬ 
dence study, or audio, video, or computer tech¬ 
nologies. 

Previous Studies 

There are abundant research studies measuring 
student satisfaction. Students’ attitudes, espe¬ 
cially their satisfaction with online courses, are 
important indicators of student success. Studies 
show a direct relation between dissatisfaction of 
distance learning and student retention. Librari¬ 
ans and educators have been exploring factors 
that enhance students’ satisfaction in web-based 
distance learning: learning styles, technology 
support, and learning community, et al. (Simp¬ 
son & Du, 2004; Frey, Alman, Barron, & 
Steffens, 2004). Previous studies reveal a pos¬ 
sibility of effects of learning styles and individual 
ability in web-based distance learning (Du, 
2004). 

One of the ability factors is students’ prior knowl¬ 
edge and skills of computers. There is abundant 
research on the effects of specific knowledge 
and skills, such as prior knowledge of 
computers, in distance learning. Prior knowledge 
is defined as the knowledge, skills, or ability that 
students bring to the learning process (Jonassen 
& Grabowski, 1993). Prior knowledge is one of 
the strongest and most consistent predictors of 
learning. Tobias states that prior knowledge can 


knowledge can be tested via a pretest devel¬ 
oped specifically for a content domain. Tests 
can be multiple choices, free recall, true/false, or 
matching among others. Some tests include a 
scale for learner to indicate their degree of con¬ 
fidence in their answer (Tobias, 1982). Research 
suggests an inverse relationship between level 
of prior knowledge and instructional support. As 
the level of prior knowledge rises, the need for 
instructional support decreases; conversely, as 
the level of prior knowledge decreases, the need 
for instructional support rises (Tobias 1976, 
1981; Jonassen & Grabowski, 1993). 

Theoretical backgrounds related to the impor¬ 
tance of prior knowledge are transfer of learning, 
schema theory, information-processing theory, 
and theory of structural knowledge. Transfer of 
learning theory explains how prior skills and 
knowledge transfer directly to new learning. 
Schema theory explains the acquisition of new 
information through a learner’s active, construc¬ 
tive integration of new information into existing 
networks of knowledge. Information-processing 
theory focuses on the roles of perception and 
attention in learning and memory (Jonassen & 
Grabowski, 1993, 421). Structural knowledge 
describes and facilitates the application of prior 
knowledge to novel situations. It is the knowl¬ 
edge of how ideas within a domain are interre¬ 
lated. In other words, structural knowledge de¬ 
scribes how prior knowledge is interconnected 
(Diekhoff, 1983). Structural knowledge is also 
defined as conceptual knowledge, the concep¬ 
tual storage of meaningful dimensions in a given 
domain of knowledge. 

In the library and information science world, a 
more relevant concept is probably “computer 
competency”, or “information technology liter¬ 
acy”. Simonson, Maurer, Montag-Toradi, & 
Whitaker (1987) define computer literacy as (1) 
an understanding of computer characteristics, 
capabilities, and applications; and (2) an ability 
to implement this knowledge in the skillful, pro¬ 
ductive use of computer applications. Specifi¬ 
cally, Osika & Sharp (2002) identified technical 
competencies for distance learning students as 
seven skill groups: (1) computer operations and 
utilities, (2) file management, (3) word process¬ 
ing, (4) Internet, (5) PowerPoint presentations, 
(6) spreadsheet, and (7) databases. On the 
other hand, more recently Talja (2005, p. 21) 
introduced a social constructivist viewpoint of 
“computer literacy” and suggests a more dialec¬ 
tical social constructs. In this study, computer 
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competency is defined as an individual’s knowl¬ 
edge and ability with computers. This knowledge 
enables an individual to use computers, soft¬ 
ware applications, databases, and other tech¬ 
nologies to achieve a wide variety of academic, 
work-related, and personal goals, including a 
successful learning experience in web-based 
courses. “Computer competency” can be an in¬ 
dicator of “computer literacy”. In this study we 
use them interchangeably. 

A related concept to “computer competency” is 
“information literacy”. Information literacy is a 
concept well discussed in library literature, for 
example, by Snavely and Cooper (1997), Carbo 
(1997), Behrens (1994), Kuhlthau (1987), 
McClure (1994), Bawden (2001), and Eisenberg, 
Lowe, & Spitzer (2004). Information literacy is a 
set of abilities requiring individuals to “recognize 
when information is needed and have the ability 
to locate, evaluate, and use effectively the 
needed information” (American Library Associa¬ 
tion, 1989). It is believed that the two concepts 
are related but information literacy has broader 
implications for the individual, the educational 
system, and society. 

A few studies explored the effects of computer 
competency to web-based distance learning. 
Jiang (1999) found students’ previous computer 
competency was not a statistical significant fac¬ 
tor in predicting students’ perceived learning, but 
it has significant correlation with student-student 
communication (p=.01), learning styles (p=.03) 
and time on learning (p=.03). His sample was 
287 web-based students from State University of 
New York Learning Network. Yu, Kim, and Roh 
(2001) found students' perceived need of web 
use, technical training they had received, per¬ 
ceived usefulness of the web, and their com¬ 
puter and web competencies had positive direct 
effects on their web use in distance learning. 

Method 

This study surveyed the effects of students’ 
computer competency to their perception of en¬ 
joyment level and difficulty level. Two research 
questions were explored: 

1. How can a student’s perception of enjoyment 
level with the course be affected by different in¬ 
dividual levels of computer competency? 

2. How can a student’s perception of difficulty 
level with the course be affected by different in¬ 
dividual levels of computer competency? 
Accordingly, two null hypotheses are: 


H0(1): There is no difference in Enjoyment Level 
when the subjects differ with regard to computer 
competency. 

H0(2): There is no difference in Difficulty Level 
when the subjects differ with regard to computer 
competency. 

In this study, computer competency was meas¬ 
ured by Computer Skill and Use Assessment, 
which was developed by the researcher. The 
survey was adapted from the Information Tech¬ 
nology Knowledge and Skills Diagnostic Tool 
(http://www.unt.edu/slis/apppacket/ITKS/ITKSas 
sess.htm), by the School of Library and Informa¬ 
tion Sciences (SLIS) at the University of North 
Texas. It is a technology skill self-assessment 
package for entering graduate students to 
evaluate their computer competency. ITKS is a 
web-based self-assessment with 197 questions. 
It has seven sections: Basic Computer Knowl¬ 
edge and Skills, Word Processing, Spreadsheet, 
Database, Presentation, Internet, and web De¬ 
velopment. Enjoyment level and difficult level 
were assessed by the Student Satisfaction Sur¬ 
vey. The Student Satisfaction Survey consisted 
of 5 items with a semantic-differential scale of 1 
to 7. The researcher chose the items for the in¬ 
strument from studies by Rumpradit (1999), and 
Osborn (2000). Both surveys were validated in 
previous studies (Du, 2004; Simpson & Du, 
2004). Participants were entering graduate stu¬ 
dents in library and information science from a 
mid-southwestern state university in the States. 

Findings 

In total, 301 subjects participated in the Com¬ 
puter Skill and Use Assessment. Among them 
237 students completed the Student Satisfaction 
Survey. Participants in this study were graduate 
students enrolled in web-based distance learn¬ 
ing courses at a mid-southwestern state univer¬ 
sity in the United States from year 2001 to 2003. 
The subjects were 100% online students; they 
came to campus for software training because 
they had never taken a WebCT course. The 
subjects were essentially homogenous in age, 
gender, and knowledge level. Fourteen of them 
were male, the rest of them were females. Aver¬ 
age age of the students was between 35 and 40. 
Over 50% of them were school librarians or 
schoolteachers working toward their master’s or 
school library certification. They all enrolled as 
regular master’s students. Eighty percent of all 
enrolled students participated in the study. The 
courses they took were taught 100% online. 
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Table 1: Descriptive Statistics of Computer Competency Items 


Item Name 

Mean 

SD 

Skewness 

Kurtosis 

Q1 FILE 

6.14 

1.04 

-1.29 

1.34 

Q2 WORD 

6.62 

.70 

-1.97 

4.11 

Q3 SPREAD 

5.23 

1.45 

-.54 

-.38 

Q4 CUT 

6.54 

1.05 

-3.37 

13.72 

Q5 PPT 

5.14 

1.66 

-.78 

-.13 

Q6 EMAIL 

6.67 

.72 

-3.36 

17.52 

Q7 INTER 

6.22 

1.03 

-1.99 

6.37 

Q8 LIST 

4.51 

1.81 

-.45 

-.64 

Q9 ACCESS 

2.05 

1.42 

1.26 

.58 

Q10 HTML 

2.88 

1.82 

.61 

-.75 

CC* 

5.2 

.80 

-.66 

1.15 


Note . CC (Computer Competency) stands for average of all ten items. 1 = least alike, 7 = most alike 


Computer Competency 

Table 1 illustrates the descriptive statistics for 
the question items. Each item has a semantic- 
differential scale, ranging from 1 to 7. One indi¬ 
cates the lowest proficiency and 7 stands for the 
highest proficiency. The researcher expected 
the mean scores of the items to be between 4 
and 5. From Table 1, the author found students 
in this sample rated themselves fairly high at 
basic computer skills, such as Q1 (Open/Run 
files and Programs, mean score = 6.14), Q2 (MS 
Word, mean score =6.62), Q3 (Spreadsheet, 
mean score = 5.23), Q4 (Cut and Paste, mean 
score = 6.54), and Q6 (Using Email, mean score 
= 6.67). Students were not familiar with com¬ 
puter languages, such as Q9 (Access Database 
Language, mean score = 2.25), and Q10 
(HTML, mean score = 2.88). 


Several reasons may have contributed to the 
distribution of the current data. Firstly, students 
may have a tendency to rate themselves higher 
if they are familiar with some skills. That might 
yield negatively skewed scores in question items 
1 to 6. Secondly, this ALA accredited library 
program expects that entering students have 
adequate skills in basic computer operation and 
can complete basic academic works, such as 
compiling homework using a word-processor. 
The students are supposed to pass the ITKS 
self-test when they apply for this program. There 
is a possibility that students who failed to pass 
the ITKS self-test but claimed to pass it were still 
allowed to enroll in the program. Thus, the 
scores of computer competency tend to be 
higher than expected. 


Table 2: Satisfaction Measurement Variables 


Name 

Mean 

SD 

Skewness 

Kurtosis 

Enjoyment Level 

5.48 

1.39 

-.88 

.21 

Performance Satisfaction 

6.00 

1.21 

-1.55 

2.7 

Difficulty Level 

4.90 

1.40 

-.71 

.29 

Grade Expectation 

6.83 

.42 

-2.18 

4.04 

Retention Tendency 

6.23 

1.48 

-2.05 

3.41 

Satisfaction Level* 

5.89 

.79 

-1.14 

.90 


Note. * Satisfaction Level is the average of all five items (N = 237). 
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Student Satisfaction 


Correlation 


As mentioned before, the researcher expected 
the mean scores of each items to be distributed 
around 4 to 5 with a bell-shape curve. Table 2 
indicates a leptokurtic and negative skewed dis¬ 
tribution of both Grade Expectation (Q4) and 
Retention Tendency (Q5), with Kurtosis more 
than 1 and Skewness less than -1. The data 
shows that most of the students expected an 
“A”, rather than a bell shape distribution, possi¬ 
bly around “B”, as suggested by statistical theo¬ 
ries. This distribution likely occurred because 
graduate students are expected to get at least a 
“B” or better. Graduate students in the sample 
also had a strong tendency toward retention, 
meaning that these students had a strong moti¬ 
vation to stay in this ALA accredited library pro¬ 
gram. This University has one of only three ALA 
accredited programs in the State of Texas. The 
Satisfaction Level score, or the average of mean 
scores of all five items, reflected a normal distri¬ 
bution of the sample. 


Since the dependent variable, computer compe¬ 
tency, yields continuous scores, multiple regres¬ 
sion analysis was applied to test the significance 
of correlation between computer competency 
and student satisfaction level. The author con¬ 
ducted five individual regression analyses on 
each question in the student satisfaction survey 
and found statistical significance in two Student 
Satisfaction items: Enjoyment Level (answers to 
question 1 of Student Satisfaction Survey as the 
dependent variable) and Difficulty Level (an¬ 
swers to question 3 of Student Satisfaction Sur¬ 
vey as the dependent variable). The results are 
listed in the next two tables. 

The next table indicated that there was a statis¬ 
tically significant correlation between computer 
competency and students’ Enjoyment Level. The 
correlation coefficient, or p weight, is .164 (p = 
0.011). That means that computer competency 
as the independent variable may predict stu¬ 
dents’ Enjoyment Level on web-based courses, 
with a correlation coefficient of .16. 


Table 3: ANOVA for Enjoyment Level 

Source Sum of Squares df MS F p p 


Regression 12.64 1 12.64 6.61 .011 .164 

Residual 457.15 239 1.913 

Total 469.79 240 


Note: Dependent Variable: Enjoyment Level. Independent Variable: Computer 


From the table below, we can conclude that 
there was a statistically significant correlation 
between computer competency and students’ 
Difficulty Level (see Table 4). The p value is 
.205 (p = 0.001). That indicates that computer 


competency as the independent variable may 
predict students’ impression of difficulty level of 
web-based courses, with a correlation coefficient 
of .205. 


Table 4: ANOVA Report for Difficulty Level 


Source Sum of 

Squares 

df 

MS 

F p p 

Regression 

20.27 

1 

20.27 

0.49 .001 .205 

Residual 

461.99 

239 

1.93 


Total 

482.27 

240 




Note: Predictors: Dependent Variable: Difficulty Level. Independent Variable: Computer competency 


There were no significant correlations between 
computer competency and Performance Satis¬ 
faction (r = .052, p = .421), Grade Expectation (r 
= .034, p = .599), and Retention Tendency (r = 


.080; p = .217). There was no significant corre¬ 
lation between computer competency and the 
average of all five items (r = .118; p = 0.069 > 
0.05). Even though the correlation is not statisti- 
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cally significant, the p-value is fairly close to .05. 
The correlation coefficient ((B) implies there 
might be a significant result if the sample size 
were larger. The researcher believes there might 
be some practical significance in enhancing stu¬ 
dents’ computer competency in web-based dis¬ 
tance learning. However, we need more studies 
to investigate that assertion. 

Conclusion and Implications 

Different student computer competency levels 
impact students’ perception of Enjoyment Level 
and Difficulty Level. Students feel web-based 
courses are easier if they have enough com¬ 
puter background. It is notable that a significant 
relationship between learning style and enjoy¬ 
ment level was found in previous studies (Simp¬ 
son & Du, 2004). The results of this study sug¬ 
gest additional factors that impact student en¬ 
joyment level in distance learning. 

The findings of this study are valuable to educa¬ 
tion libraries. Understanding the effects of com¬ 
puter competency may help faculty to deliver 
learning materials more effectively online. Stu¬ 
dents in education or school library programs 
with higher level of computer competency are 
likely to be more satisfied with distance learning. 
Such students will be more creative with peda¬ 
gogical innovation, such as utilizing Internet re¬ 
sources, using databases, and creating digital 
media in teaching and learning. Those en¬ 
hanced skills may help them to achieve a wide 
variety of academic, work-related, and personal 
goals. 

To better serve distant students and enhance 
student retention, we suggest technology sup¬ 
port in distance education programs. Our results 
are consistent with findings from previous stud¬ 
ies (Yu et al., 2001) suggesting that technology 
support should be provided to learners in order 
to facilitate the participation of web-based learn¬ 
ing. 

Students without adequate technology back¬ 
ground should be given tutorials or training ses¬ 
sions to help them adjust to the online environ¬ 
ment. Distance learning programs in libraries 
should provide onsite training sessions to en¬ 
hance computer competency for students with¬ 
out enough prior knowledge of computers. In 
addition, distance programs might consider de¬ 
ploying budget in supporting students and an¬ 
swer students’ technical questions in real-time 


via telephone, instant messaging, video confer¬ 
ence, et al (Lowe & Malinski, 2000). 

The researcher found no statistically significant 
relationship between computer competency and 
pooled score of student satisfaction from all five 
question items. He sampled students from dif¬ 
ferent majors and from different online classes. 
Different course types may yield a significant 
level of “within group variance’’ and thus yielded 
non-significant results. The researcher believes 
with a larger sample size significant results may 
be found. Computer competency may not the 
only factor predicting students’ success in web- 
based distance learning. Further studies are 
needed to explore the interaction of computer 
competency and different course delivering plat¬ 
forms, such as GUI-based (such as WebCT) vs. 
text-based (Blackboard) systems. 
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Appendix: Computer Skill and Use Assessment 


Rate your ability to do each of the following: 

(circle the appropriate number, from 1 (no knowledge/ability) to 7 

No knowledge 1 


1. Find, open and run files and programs 1 

2. Create a document using a word processor 1 

3. Use a spreadsheet to create a document 1 

4. Cut, copy, and paste text 1 

5. Create a presentation document on a computer 1 

6. Send and receive e-mail 1 

7. Search for information on the Internet/World Wide Web 1 

8. Subscribe and post messages to a “listserv” 1 

9. Program a computer using a database language 

(such as Access, Foxpro or Oracle, etc.) 1 

10. Create or edit a Website (using html, Java, etc.) 1 

11. Electronically send and receive files 1 


(expert user)) 

2 3 4 5 6 7 Expert user 
2 3 4 5 6 7 
2 3 4 5 6 7 
2 3 4 5 6 7 
2 3 4 5 6 7 
2 3 4 5 6 7 
2 3 4 5 6 7 
2 3 4 5 6 7 
2 3 4 5 6 7 

2 3 4 5 6 7 
2 3 4 5 6 7 
2 3 4 5 6 7 


12. Generally, how satisfied are you with your computer ability (choose one) 
O Very Dissatisfied 
O Dissatisfied 

O Dissatisfied with reservation 
O Satisfied 
O Very Satisfied 

O No Basis for Judgment/ Not Applicable 


Comments: 
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